Prostate Motion Modelling Using Biomechanically-Trained Deep Neural Networks on Unstructured Nodes

In this paper, we propose to train deep neural networks with biomechanical simulations, to predict the prostate motion encountered during ultrasound-guided interventions. In this application, unstructured points are sampled from segmented pre-operative MR images to represent the anatomical regions of interest. The point sets are then assigned with point-specific material properties and displacement loads, forming the un-ordered input feature vectors. An adapted PointNet can be trained to predict the nodal displacements, using finite element (FE) simulations as ground-truth data. Furthermore, a versatile bootstrap aggregating mechanism is validated to accommodate the variable number of feature vectors due to different patient geometries, comprised of a training-time bootstrap sampling and a model averaging inference. This results in a fast and accurate approximation to the FE solutions without requiring subject-specific solid meshing. Based on 160,000 nonlinear FE simulations on clinical imaging data from 320 patients, we demonstrate that the trained networks generalise to unstructured point sets sampled directly from holdout patient segmentation, yielding a near real-time inference and an expected error of 0.017 mm in predicted nodal displacement

Multiresolution eXtended Free-Form Deformations (XFFD) for non-rigid registration with discontinuous transforms

Image registration is an essential technique to obtain point correspondences between anatomical structures from different images. Conventional non-rigid registration methods assume a continuous and smooth deformation field throughout the image. However, the deformation field at the interface of different organs is not necessarily continuous, since the organs may slide over or separate from each other. Therefore, imposing continuity and smoothness ubiquitously would lead to artifacts and increased errors near the discontinuity interface. In computational mechanics, the eXtended Finite Element Method (XFEM) was introduced to handle discontinuities without using computational meshes that conform to the discontinuity geometry. Instead, the interpolation bases themselves were enriched with discontinuous functional terms. Borrowing this concept, we propose a multiresolution eXtented Free-Form Deformation (XFFD) framework that seamlessly integrates within and extends the standard Free-Form Deformation (FFD) approach. Discontinuities are incorporated by enriching the B-spline basis functions coupled with extra degrees of freedom, which are only introduced near the discontinuity interface. In contrast with most previous methods, restricted to sliding motion, no ad hoc penalties or constraints are introduced to reduce gaps and overlaps. This allows XFFD to describe more general discontinuous motions. In addition, we integrate XFFD into a rigorously formulated multiresolution framework by introducing an exact parameter upsampling method. The proposed method has been evaluated in two publicly available datasets: 4D pulmonary CT images from the DIR-Lab dataset and 4D CT liver datasets. The XFFD achieved a Target Registration Error (TRE) of 1.17 ± 0.85 mm in the DIR-lab dataset and 1.94 ± 1.01 mm in the liver dataset, which significantly improves on the performance of the state-of-the-art methods handling discontinuities

Point-Spread-Function-Aware Slice-to-Volume Registration: Application to Upper Abdominal MRI Super-Resolution

MR image acquisition of moving organs remains challenging despite the advances in ultra-fast 2D MRI sequences. Post-acquisition techniques have been proposed to increase spatial resolution a posteriori by combining acquired orthogonal stacks into a single, high-resolution (HR) volume. Current super-resolution techniques classically rely on a two-step procedure. The volumetric reconstruction step leverages a physical slice acquisition model. However, the motion correction step typically neglects the point spread function (PSF) information. In this paper, we propose a PSF-aware slice-to-volume registration approach and, for the first time, demonstrate the potential benefit of Super-Resolution for upper abdominal imaging. Our novel reconstruction pipeline takes advantage of different MR acquisitions clinically used in routine MR cholangiopancreatography studies to guide the registration. On evaluation of clinically relevant image information, our approach outperforms state-of-the-art reconstruction toolkits in terms of visual clarity and preservation of raw data information. Overall, we achieve promising results towards replacing currently required CT scans

Group-wise similarity registration of point sets using Student’s t-mixture model for statistical shape models

A probabilistic group-wise similarity registration technique based on Student’s t-mixture model (TMM) and a multi-resolution extension of the same (mr-TMM) are proposed in this study, to robustly align shapes and establish valid correspondences, for the purpose of training statistical shape models (SSMs). Shape analysis across large cohorts requires automatic generation of the requisite training sets. Automated segmentation and landmarking of medical images often result in shapes with varying proportions of outliers and consequently require a robust method of alignment and correspondence estimation. Both TMM and mrTMM are validated by comparison with state-of-the-art registration algorithms based on Gaussian mixture models (GMMs), using both synthetic and clinical data. Four clinical data sets are used for validation: (a) 2D femoral heads ( 1000 samples generated from DXA images of healthy subjects); (b) control-hippocampi ( 50 samples generated from T1-weighted magnetic resonance (MR) images of healthy subjects); (c) MCI-hippocampi ( 28 samples generated from MR images of patients diagnosed with mild cognitive impairment); and (d) heart shapes comprising left and right ventricular endocardium and epicardium ( 30 samples generated from short-axis MR images of: 10 healthy subjects, 10 patients diagnosed with pulmonary hypertension and 10 diagnosed with hypertrophic cardiomyopathy). The proposed methods significantly outperformed the state-of-the-art in terms of registration accuracy in the experiments involving synthetic data, with mrTMM offering significant improvement over TMM. With the clinical data, both methods performed comparably to the state-of-the-art for the hippocampi and heart data sets, which contained few outliers. They outperformed the state-of-the-art for the femur data set, containing large proportions of outliers, in terms of alignment accuracy, and the quality of SSMs trained, quantified in terms of generalization, compactness and specificity

NiftySim: A GPU-based nonlinear finite element package for simulation of soft tissue biomechanics

Purpose NiftySim, an open-source finite element toolkit, has been designed to allow incorporation of high-performance soft tissue simulation capabilities into biomedical applications. The toolkit provides the option of execution on fast graphics processing unit (GPU) hardware, numerous constitutive models and solid-element options, membrane and shell elements, and contact modelling facilities, in a simple to use library. Methods The toolkit is founded on the total Lagrangian explicit dynamics (TLEDs) algorithm, which has been shown to be efficient and accurate for simulation of soft tissues. The base code is written in C ++++ , and GPU execution is achieved using the nVidia CUDA framework. In most cases, interaction with the underlying solvers can be achieved through a single Simulator class, which may be embedded directly in third-party applications such as, surgical guidance systems. Advanced capabilities such as contact modelling and nonlinear constitutive models are also provided, as are more experimental technologies like reduced order modelling. A consistent description of the underlying solution algorithm, its implementation with a focus on GPU execution, and examples of the toolkit’s usage in biomedical applications are provided. Results Efficient mapping of the TLED algorithm to parallel hardware results in very high computational performance, far exceeding that available in commercial packages. Conclusion The NiftySim toolkit provides high-performance soft tissue simulation capabilities using GPU technology for biomechanical simulation research applications in medical image computing, surgical simulation, and surgical guidance applications

Prostate Motion Modelling Using Biomechanically-Trained Deep Neural Networks on Unstructured Nodes

In this paper, we propose to train deep neural networks with biomechanical simulations, to predict the prostate motion encountered during ultrasound-guided interventions. In this application, unstructured points are sampled from segmented pre-operative MR images to represent the anatomical regions of interest. The point sets are then assigned with point-specific material properties and displacement loads, forming the un-ordered input feature vectors. An adapted PointNet can be trained to predict the nodal displacements, using finite element (FE) simulations as ground-truth data. Furthermore, a versatile bootstrap aggregating mechanism is validated to accommodate the variable number of feature vectors due to different patient geometries, comprised of a training-time bootstrap sampling and a model averaging inference. This results in a fast and accurate approximation to the FE solutions without requiring subject-specific solid meshing. Based on 160,000 nonlinear FE simulations on clinical imaging data from 320 patients, we demonstrate that the trained networks generalise to unstructured point sets sampled directly from holdout patient segmentation, yielding a near real-time inference and an expected error of 0.017 mm in predicted nodal displacement

Bubble-Enriched Smoothed Finite Element Methods for Nearly-Incompressible Solids

This work presents a locking-free smoothed finite element method (S-FEM) for the simulation of soft matter modelled by the equations of quasi-incompressible hyperelasticity. The proposed method overcomes well-known issues of standard finite element methods (FEM) in the incompressible limit: the over-estimation of stiffness and sensitivity to severely distorted meshes. The concepts of cell-based, edge-based and node-based S-FEMs are extended in this paper to three-dimensions. Additionally, a cubic bubble function is utilized to improve accuracy and stability. For the bubble function, an additional displacement degree of freedom is added at the centroid of the element. Several numerical studies are performed demonstrating the stability and validity of the proposed approach. The obtained results are compared with standard FEM and with analytical solutions to show the effectiveness of the method

Transversal crack and delamination of laminates using XFEM

This paper offers a new insight into the computational modelling of crack and delamination of carbon fiber composite. Both transversal cracks (intralaminar) and delamination (interlaminar) are modelled with Extended Finite Element Method (XFEM). Constitutive and fracture laws are integrated to model the initiation of crack or delamination, and their subsequent evolution. The study includes the size effect assessment of composite due to the increment of composite thickness. The results are in close agreement between the experimental and analytical data of each specimen modelled based on the size of the carbon fiber composite volume